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GUI CONTROL METHOD AND APPARATUS AND RECORDING MEDIUM ' 
[0001 ] 

FIELD OF THE INVENTION 
5 This Invention relates to a graphical user interface GUI 

technique in an information processing apparatus. More 
particularly, it relates to a GUI control method, program and 
apparatus for improving the tractability and convenience in use 
of a software having the GUI and which is run on a computer 
10 typified by a personal computer (PC) or a workstation (WS) . 
[0QQ2] 

BACKGROUND OF THE INVENTION 

In order to make a software, adapted for running on a 
computer, such as PC or WS, and having the GUI. convenient to 
15 use for a user, the applicable use of a software, that is what 
can be done using the software, and an operational sequence for 
the use, need to be definite for the user. 
[0003] 

In the case of an E-MAIL software, [reading a mail], 
20 [sending a mail] and [making an answer] are among the items of 
the applicable use of the software. It is also desirable that 
these Items of use be readily understood by a user, that is that 
the user may readily comprehend that he or she is able to read 
or transmit a mail on the use of the software, and that, if once 
25 the applicable use is decided, it may readily be understood in 
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What sequence the software is to be operated In such use. 
[0004] 

This condition (demand) is particularly crucial for a 
beginner user with only poor experience in the computer. 
5 [0005] 

If the applicable use of the software is not definite, the 
user is unable to realize what can be done on the computer, so 
that the objective fn using a computer (what one desires to do 
on the com outer) cannot be achieved. Even if the appi icable use 
10 of the software are realized, the user is at a loss how to operate 
the computer, except if the operational sequence is definite, 
so that again the objective in using a computer cannot be 
achieved. 

[0006] 

15 Fig. 29 shows a typical conventional screenshot (picture 

screen) of a software with GUi adapted for running on a computer, 
such as PC or WS. In a typical conventional display of a software 
with GUI, as shown in Fig. 29, the functions of the software are 
displayed/represented on a menu or as icons, and the user 

20 exploits this software by selecting the menu or icon. 
[0007] 

In the case of Fig. 29. [FILE], [ED I T] and [V I EWI e t c. be I ong 
to the menu items, with smail rectangular widgets shown 
therebelow being icons. The numbers of these menu i terns and icons 
25 become iarger, the larger, the number of the functions provided 
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in the software. 
[0008] 

SUMMARY OF THE DISCLOSURE 

In the typical conventional screenshot of a software with 
5 GUI, as described above, the functions provided in the software 
are displayed by menus or Icons, however, the applicable use of 
the software is not clarified. For example, there are [creating 
a new document] or [opening and editing a document] among the 
items of applicable use of the software, a typical screenshot 
10 of which is shown In Fig. 29, however, the corresponding 
applicable use is not clarified on the screenshot shown in 
Fig. 29. 

[0009] 

On the other hand, current software products are mostly not 
15 provided with a mechanism for guiding (instructing) an 
operational seauence for exploiting the software in each 
applicable use. 
[0010] 

So, with a beginner user with only little experience In a 
20 computer, it is difficult to achieve the objective of using a 
software, that is, to realize what he or she wishes- 
[001 1] 

As methods for displaying the applicable use or guiding the 
operational sequence of the software, there may be envisaged 
25 (1) a method of endowing the software itself with a 
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mechanism displaying the applicable use or guiding the 
operatfonal sequence of the software; and 

(Z) a method of realizing a mechanism operated with the 
software for displaying the use or guiding the operational 
5 sequence of the software from outside the software without 
changing the program of the software. 
[00121 

In the above method (1). the majority of the pre-existing 
soft wa re is not Internally provided with such mechaiiism. If It 
10 is desired to provide a pre-existing software with display of 
the use and with the operational sequence guiding mechanism, it 
is necessary to change the software program. 

[0013] 

It is usually only the software supplier who can execute 
15 such change, whi le a third party other than the software suppi ier 
is unable to change the software to realize the above-mentioned 
mechan i sm. 
[0014] 

In the case of the method (2)i the mechanism such as 
20 indication of use or operational sequence guiding can be 

realized without changing the pre-existing software. However, 
there lacks such a method or mechanism which realizes such 
mechanism, 

[0015] 

25 On the other hand, the number of menu items or icons on the 
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software window becomes larger, the larger the number of the 
functions provided on the software. As the functions provided 
on the software becomes diversified, and the number of GUI 
widgets such as menu items or icons, the operational sequence 
5 becomes comp II cated. I n pa r t i cu I ar, i n case of a beg I nne r user 
with only poor experience in the computer, it is difficult to 
achieve the objective of using the software, 



10 portion of the diversified functions, and who does not exploit 
other functions, the operational sequence would be clearer If 
a more simplified presentation Is displayed, in which only the 
GUI widgets required are presented, without presenting the 
totality of the GUI widgets for the required functions. 

15 [0017] 

As a method for realizing a mechanism of displaying a 
s i mo I i f i ed presentat 1 on (screenshot) i n p I ace of a o resen t a t i on 
(screenshot) inherent to the software, there may be envisaged 

(1) a method of providing the software itself with a 

20 simplified presentation (screenshot) other than and In place of 
an inherent presentation (screenshot) of the software; and 

(2) a method of not changing the software program, but 
realizing a mechanism operated with the software for displaying 
the s I fflD ! i f i ed p r es en ta t i on (screenshot) f or v I ewl ng by the user 

25 from outside the software, for notifying the operation for the 



[0016] 



For a beginner user, or a user who is in need of only a 
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presentation (screenshot) as an ODeration to the Inherent 
presentation (screenshot) of the software, while hiding the 
inherent presentation (screenshot) without presenting it to the 
user. 
5 [0018] 

However, with the method (1), the majority of the pre- 
existing software Is not provided with the corresponding 
internal tnechanisin, so that, If desired to endow the software 
with such internal mechanism, the software program needs to be 
10 changed. Moreover, it is usuailyonly the software supplierwho 
can execute such change, while a third party other than the 
software supplier is unable to change the software to realize 
the above-mentioned mechanism. 

[001 9] 

15 On the other hand, in the case of the method (2), the 

mechanism which allows the user to act on a screenshot different 
from the screenshot Inherent to the software can be realized 
without changing the pre-existing software. However, there 
lacks such a method or apparatus which realizes such mechanism. 

20 [0020] 

As a technique relevant to the present invention, there is 
disclosed in e.g., the JP Patent Kokal J P-A-1 0-207676 such an 
arrangement In which, as a guide type application supporting 
system of learning the operating method of the application 

25 software and actual operating, unified together, the 
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operational sequence for the application software and the guide 
information are saved in a database, and which is made up of 
application communication means for directly running the 
selected application software in accordance with the 
5 operational seouence saved in the database and, user 

presentation means for instructing the operating method for the 
application software directly operated by the application 
communication means by the image and the audio Information in 
accordance with the guide information saved in the database. 
10 [0021] 

There is also disclosed In JP Patent Kokal J P-A-06-01 9662 
a help display device for an Information processing apparatus 
In which, in executing an application program, the operational 
flow diagram showing the operational sequence In a tree 

15 configuration from function to function is prepared and 

presented to the user, and inwhich status transit! on indicating 
the status trans ition In the flow diagram for informing the user 
position by thick a r rows and the route to the specified function 
may also be prepared and presented to the user. 

20 [0022] 

There is also disclosed in JP Patent Kokai JP-A-02-300913 
a software program operational sequence Instructing device 
comprised of means for storing in memory means the operational 
sequence and the processing contents furnished by the software 

25 program, comparing the information on the operational sequence 
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fed to input means to the information on the operational sequence 
and the processing contents furnished by the software program 
and for verifying the point of difference between the two 
operational sequences and means for selecting and recommending 
5 the operational sequence information most analogous to the 
operational sequence stored in the memory means based on the 
checlced result. 
[00231 

For example, in the JP Patent Kokai JP-A-1 1 -237978, there 
10 is disclosed a graphical user interface forming apparatus in 
which the CO- referencing between the menu item and the GUI widget 
may be comprehended at a glance- 

[0024] 

There is also disclosed in JP Patent Kokai JP-A-11-271 539 
15 a GUI picture forming system comprised of a display unit made 
up of a work area window for displaying a GUI picture, a widget 
list window for displaying pre-defined widgets, a widget list 
window for displaying combination widgets defined and 
registered by the picture purveyor and a tooi window for 
20 displaying variable control tools, a GUI picture forming system 
having enclosed therein the combination widget registering 
process, and a f i I e un i t made up of the p i cture f i I e, widgetfile 
and the combination widget file. The picture provider is able 
to define in combination, register and re-use the widgets of the 
25 pre-defined minimum units to furnish a highly efficient tool. 
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[0025] 

Moreover, here is disclosed in e.g., the JP Patent Kokai 
J P-A-1 1-259200 a system and a method for setting user-definable 
command elements on a user interface in which, when a user 
5 desirous to execute a specified program task sets a visual 
command element on a user interface command necessary for 
executing the specified task, and selects a proper menu command 
in subsequently executing the same task, the user may be guided 
automatically from the visual command elements, such that* if 
10 the user selects a specified menu command, the visual command 
element can be automatical ly set in the total ity of the specified 
menu commands to be selected In achieving the specified menu 
command, In which the sequence to be selected in executing a 
specified task may be automatically set in the specified menu 
15 command having a visual command element, and in which the 

sequence to be selected for the specified menu command having 
the visual command element to execute a specified task is 
presented to the user. 

[0026] 

20 As a navigation tool for personal computer operation, there 

is now comme r c I a I I y available a software produced manufactured 
by SHARP CO. LTD. under the trade name of [PC navigator] 
(http:// sharp- wo rid. com/sc/exci t e/sof t,map/ces02pn/) . With 
this [PC navigator], if a user queries what he or she desires 

25 to know in the natural language and clicks a relevant button, 



m]^ mm mmmmn no. 6284 p. n 



a list of the response to the Queried contents is displayed. If 
then the operation is selected and the relevant button clicked, 
the oersonal computer navigator automatically executes the 
operations. Moreover, since sample pictures or screenshots of 
5 the Word and Excel, both being the trademarks owned by Microsoft 
Corporation, and the Window (R) , similarly a registered 
trademark owned by Microsoft Corporation, are provided, to 
provide a sample input function, so that an operation the user 
des 1 res can be f ound^ 
10 [0027] 

However, the above-mentioned problem cannot be settled by 
these known techniques. 
[0028] 

It is therefore an object of the present invention to 
15 provide a GUI control method, apparatus and program which 

clarify the applicable use of an optional software to guide the 
operational seauence to enable an operation on a presentation 
(screenshot) different from the inherent screen without 
modifying the software provided with the GUI, so that even a 
20 beginner user will be able to exploit the software readily. 
[0029] 

For accomplishing the above object, the present Inventors 
have completed an Invention pertinent to a method, an apparatus 
and a program product as defined in the claims. 
25 According to a first aspect of the present invention^ the 
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applicable use of the software Is demonstrated in a menu form 
on a presentation (screenshot) of a display apparatus. If one 
use is selected on the menu, a GUI (graphical user interface) 
widget to be acted on next is demonstrated in a configuration 
5 outstanding from the surrounding backgrounds in a pre^stored 
operational sequence. These operations are sequentially 
carried out to guide the operational sequence for realizing the 
above use. 
[0030] 

10 According to a second aspect of the present invention, a 

cover screen hiding an inherent screen of the software may be 
demonstrated on the display device, wherein the applicable use 
of th e software is demonstrated in a menu form on the cover screen. 
If an operation is performed on the cover screen, an operation 
15 equivalent to that performed on the cover screen is then executed 
on the inherent screen of the software In accordance with a 
pre-regi s tered relationship with widgets. 
[0031] 

Moreover, the present invention includes 
20 (a) a step of previously registering in a storage unit the 

applicable use of a software adapted for running on a computer, 
the computer having a GUI; 

(b) a step of displaying the registered use as a menu item 
on a screen of a display device, inputting an operational 
25 sequence of the software, as required for utilizing the. software 
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in the use, for registration in the storage unit, for eaci) use 
displayed on the menu; and 

(c) a step of booting, on selection of the use from the menu, 
the software as required for the selected use. of detecting in 
5 what location in the screen a GUI widget to be acted on ne^ct, 
in accordance with the operating sequence previously registered 
for the selected use. and of displaying the detected GUi widget 
In a highlighted fashion on the screen or picture in accordance 
with the detected display location for the GUI; and 

10 (d) a step of detecting an operation of said GUI widget, 

in accordance with the previously registered operating sequence, 
of detecting in what position on the screen a GUI widget to be 
operated next, and of displaying the GUI widget in a highlighted 
fashion on the screen or picture, in accordance with the next 

15 detected display location of the next GUI widget. 



applicable use of a software adapted for running on a computer, 
20 the software having a graphical user interface GUI. 

use menu registration means for previously registering a 
use menu displayed by the use menu display means, 

use selection detection means for detectings on selection 
of the use from the use menu displayed on the use menu display 
25 means, what use has been selected, 



[0032] 



The GUI control apparatus includes: 



use menu display means for dispiayingt in a menu, the 
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software booting means for booting the software reauired 
for the selected use. 

operational sequence registration means for previously 
registering the operational sequence for acting on the software 
5 in the selected use. 

widget detection means for detecting in what location on 
the screen the GUI widget to be ope r a t ed nex t is to be displayed 
on a screen, in accordance with an operating sequence registered 
for the se lected usGt 
10 operation target widget indicating means for displaying 

the GUI widget detected by the widget detection means in a 
highlighted fashion on a screen or picture, and 

operation detection means for detecting an operation made 
on a GUI widget detected by the widget detection means and for 
15 instructing the widget detection means to detect, in accordance 
with an operating sequence registered for the selected use. in 
what location on the screen the next GUI widget to be operated 
on next is d i sp I ayed^ 

Further aspects of the invention are disclosed in the 
20 entire claims which are incorporated herein by reference 
thereto. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 shows a configuration of a first embodiment of a GUI 
control device according to the present invention. 
25 Fig. 2 schematically shows a typical registration of a use 
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menu in the first embodiment of the present invention. 

Fig. 3 schematically shows a typical display screenshot of 
the use menu in the first embodiment of the present invention. 

Fig. 4 shows a typical screenshot (displayed picture 
5 screen) of the use menu in the first embodiment of the present 
invention. 

Figs. 5a and 5b show a typical screenshot (picture screen) 
of the software in the first embodiment of the present invention. 

Fig. 6 shows an Illustrative operational sequence 
10 registered in operational sequence registration means 105 in the 
first embodiment of the present invention. 

Fig; 7 shows a typical display In which a widget designated 
by an operation target widget indicating unit 106 is shown 
highlighted in the first embodiment of the present invention. 
15 Fig.8 shows a typical display in which a widget by the 

operation target widget indicatlngunit 106 is shown h I gh I i gh ted 
in the first embodiment of the present invention. 

Fig. 9 shows typical widget display by a widget display unit 
108 in the first embodiment of the present invention. 
20 Fig, 10 shows a configuration of a second embodiment of the 

present invent ion. 

F I g. 1 1 shows a typical screenshot (displayed picture 
screen) of the use menu in the second embodiment of the present 
invent! on. 

25 Fig. 12 shows a configuration of a third embodiment of the 
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present invention. 

Fig. 13 schematically shows a typical registration of the 
use menu in the third embodiment of the present invention. 
Fig. 14 shows a typical registration of the use menu in the 
5 third embodiment of the present invention. 

Fig. 15 shows a typical registration of the use menu in the 
third embodiment of the present invention. 

Fig. 16 shows a typical relation (correspondence) of 
widgets registered in the widget-relation information 
10 registrat ion unit 1210. 

Fig. 17 shows a typical software screenshot (picture 
screen) in the third embodiment of the present invention. 

Fig. 18 shows a typical software screenshot in the third 
embodiment of the present invention. 
15 Fig. 19 shows a typical cover screen in the third embodiment 

of the present invention. 

Fig. 20 shows a typical relation of widgets registered in 
the widget-relation information registration unit 1210. 

Fig. 21 shows a typical relation of widgets registered in 
20 the widget-relation information registration unit 1210. 

Fig. 22 shows a typical cover screen in the third embodiinent 
of the present invention. 

Fig. 23 shows a typical relation of widgets registered in 
the widget-relation information registration unit 1210. 
25 Fig. 24 shows a typical relation of w i dge t s- r e I a t i on 
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information registered in the wi dget-re I at i on i nf orrnat i on 
reg i s t ra t i on unit 1210. 

Fig. 25 shov/s a typical software screenshot in the third 
embodiment of the present invention. 
5 Fig. 26 shows a typical software screenshot in the third 

embodiment of the present invention. 

Fig. 27 shows a configuration showing a fourth embodiment 
of the present Invention. 

Fig. 28 shows a configuration showing a fifth embodiment of 
10 the present i nvent i on. 

Fig. 29 shows a typical presentation (screenshot) of a 
software running on a control computer and which has a GUI. 

[0033] 

PREFERRED EIMBODIMENTS OF THE INVENTION 

15 An embodiment of the present invention is explained in 

detail by referring to the drawings. Referring to Fig. It a GUI 
control apparatus according to a preferred embodiment of the 
present invention includes use menu display unit 100 for 
displaying. In a menu, the applicable use of a software adapted 

20 for running on a computer and having a graphical user Interface 
GUI, use menu registration unit 101 for previously registering 
a use menu displayed by the use menu display unit, use selection 
detection unit 102 for detecting, on selection of the use from 
the use menu displayed on the use menu display unit, which use 

25 has been selected, software booting unit 103 for booting the 
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software required for the selected use, operation sequence 
registration unit 105 for previously registering the 
ooeratlona! seauence for acting on the software in the selected 
use, widget detection unit 104 for detecting in which location 
5 on the screen the GUI widget to be acted on next is to be displayed 
on a screen or picture, in accordance with an operating sequence 
registered for the selected use, operation target widget 
indicating unit 106 for displaying the GUI widget detected by 
the widget detection unit in a highlighted fashion on a screen 

10 or picture, and operation detection unit 107 for detecting an 
action made on a GUI widget detected by the widget detection unit 
and for instructing the widget detection unit to detect, in 
accordance with an operating sequence registered for the 
selected use. in what location on the screen the GUI widget to 

15 be acted on next Is displayed. 
[0034] 

Referring to Fig. 10, another preferred embodiment of the 
GUI control apparatus according to the present invention 
includes software booting detecting unit 1000 for detecting 

20 hooting of a software adapted for running on a computer, the 
software having a graphical user interface GUI, use menu display 
un i t 1 OOf or d i s p I ay i ng, inamenu, the app I i cab I e use of a booted 
software, use menu registration unit 101 for previously 
registering a use nienu displayed by the use menu display unit, 

25 use selection detection unit 102 for detecting, on selection of 
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the use from the use menu disolayed by the use menu display unit 
which use has been detected 105 operational sequence 
registration unit for previously registering an operational 
sequence for acting on the software in the selected use, widget 
5 detection unit 104 for detecting, in accordance with an 

operational sequence registered for the selected use. by the 
operational seauence registration unit, in which location on a 
screen the GUI widget to be acted on next is displayed, operation 
target widget Indicating unit 106 for displaying the GUI widget 

10 detected by the widget detection unit 104 in a highlighted 
fashion on a screen or picture, and operation detection unit 107 
for detecting an action on a GUI widget detected by the widget 
detection unit and for instructing thewidget detection unit 104 
to detect, in accordance with an operational sequence registered 

15 by the operational sequence registration unit, in what location 
on the screen the GUI widget to be acted on next is displayed. 
[0035] 

The present invention includes a unit 108 for displaying 
a GUI widget for notifying the completion of processing on a 
20 current screen, in which the operation detection unit 107 

detects an operation performed on the GUI widget detected by the 
widget detection unit 104 or on the GUI widget displayed by the 
w i dget display unit 108. 

[0036] 

25 Referring to Fig, 12, another preferred embodiment of the 
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GUI control apparatus according to the present invention 
includes a use menu displaying unit 1203 for demonstrating on 
a menu the applicable use of a software operating on a computer, 
tiie software having a graphical user interface GUI, use menu 
5 registration unit 1202 for previously registering the use menu 
demons t rated by the use menu d i s p 1 ay 1 ng un i t 1 203, useselectlon 
detection unit 1 204 for detecting the use selected from the use 
menu demonstrated by the use menu displaying unjt1202, software 
booting unit 1205 for booting a software necessary for the 

10 selected use, cover screen registrat Ion uni t 1 200 for previously 
registering, as a cover screen, a picture for employing the 
booted software in the selected use, cover screen display unit 
1201 for hiding an inherent screen of the booted software and 
for visibly demonstrating the cover screen registered by the 

15 cover screen registration unit in its stead, operation detection 
unit 1206 for detecting an operation on the GUI widget 
demonstrated on the cover screen to instruct the cover screen 
registration unit 1200 to display the cover screen, widget- 
relation (correspondence) information registration unit 1210 

20 for previously registering widget-relation information as to 
which GUi widget on the inherent screen of the software is to 
be acted on depending on any of the GUI widgets on the cover 
screen has been acted on, widget detection unit 1207 for 
detecting, depending on the widget-relation information 

25 registered by thewidget-relation information registration unit, 
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in what location on the inherent screen of the software the GUI 
widget to be acted on next is demonstrated, and operation event 
issuing unit 1208 for issuing an operating event on the GUI 
widget detected by the widget detection unit 1207. It is 
5 previously registered by the widget-relation information 

reg i s t rat I on unit 1210 any of the GUI widsets on the cov6r scrBen 
data displayed in any of the GUI widgets on the Inherent screen 
of the software is to be copied. There is provided displayed 
data copying unit 1 209 for copying the data displayed in a GUI 
10 widget on the inherent screen of the software in the GUI widget 
on the cover screen in accordance with the wi dget-rc I at ion 
information registered by the widget-relation information 
reg i s t ra t i on unit 1210. 
[0037] 

15 Referring to Fig. 27, still another preferred embodiment of 

the GUI control apparatus according to the present invention 
includes use menu registration unit 1202 for previously 
registering the applicable use of a software, cover screen 
registration unit 1200 for previously registeringa picture for 

20 using the software for the application as a cover screen, cover 
screen displaying unit 1201 for detecting the booting of the 
software, hiding an inherent screen of the booted software and 
for visibly demonstrating the cover screen registered by the 
cover screen registration unit in its stead, use menu displaying 

25 unit 1203 for demonstrating the applicable use of the booted 
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software as a menu on the cover screen demonstrated by the cover 
screen display unit, use selection detection unit 1204 for 
detecting, on selection of a use from the menu, which use has 
been selected, operation detection unit 1206 or detecting an 
5 operation on a GUI (graphical user interface) widget displayed 
on the cover screen, widget-relation information registration 
unit 1210 for previously registering indicating which GUI widget 
on an inherent screen on the software is to be actuated upon 
actuation of any of the GUI widgets on the cover screen, widget 

10 detection unit 1207 for detecting in what location on an inherent 
screen of the software the GUI widget to be acted on next Is 
demonstrated in accordance with w i dge t- r e I a t i on information 
registered by the widget-relation information registration unit 
1210, and operating event issuing unit 1208 for issuing an 

15 operating event for a GUI widget detected by the widget detection 
unit 1207. It is previously registered by the w i dge t- re I a 1 1 on 
information registration unit 1210 in which GUI widget on the 
cover screen data displayed In which GUI widget on the inherent 
screen of the software is to be copied. There is provided 

20 displayed data copying unit 1 209 for copying the data displayed 
in a GUI widget on the inherent screen of the software in the 
GUI widget on the cover screen in accordance with the 
widget-relation information registered by the w i dge t-r e I a 1 1 on 
information registration unit 1210. 

25 [0038] 
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The functions and the processing of the above-mentioned 
respective unit are real ized by a program executed on a computer. 
That is. from a medium, such as a communication medium, carrying 
the program, the program is read into a computer via a preset 
5 interfacing unit and installed. The form of executing the 
program is loaded on a main memory of the computer and executed 
to carry out the present invention. 

[0039] 

The GUI control method according to the present invention 
10 preferably is comprised of the following respective steps: 
[0040] 

(a) a step of previously registering In a storage unit the 
applicable use of a soft wa re adapted for running on a computer, 
without changing the program of the software, the computer 

15 having a GUI. 

[0041] 

(b) a step of displaying the registered use as a menu on 
a screen of a display device, inputting an operational sequence 
of the software, as reauired for utilizing the software in the 

20 use, for registrat ion in the storage un i t. f or each use d i sp I ayed 
on the menu, 
[0042] 

(c) a step of booting, on selection of the use from the menu, 
the software as required for the selected use, detecting, by 

25 detection unit, in which location In the screen a GUI widget to 
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be acted on next, in accordance with the operating sequence 
previously registered for th selected use, and of displaying the 
detected GUI widget in a highlighted fashion on the screen or 
picture in accordance with the detected display location for the 
5 GUI, and 

[0043] 

(d) a step of detecting an action of the GUI widget, 
instructing the detection unit, in accordance with the 
previously registered operating sequence, to detect in which 
10 position on the screen a GUI widget to be acted on next and 
displaying the GUI widget in a highlighted fashion on the screen 
or picture, in accordance with the detected display location of 
the GUI widget. 
[0044] 

15 A GUI control method in another embodiment of the present 

invention IncI udes 
[0045] 

(a) a step of previously registering in a storage unit the 
applicable use of a software adapted for running on a computer, 

20 the computer having a GUI. 
[0046] 

(b) a step of detecting, on booting the software, such 
booting of the software, and displaying the applicable use of 
the software on a screen of a display device. 

25 [0047] 
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(c) a step of registering in the storage unit the operating 
sequence of tlie software for utilizing the software in the use. 
for each of the use displayed on the menu, 

[0048] 

5 (d) detecting, on selection of the use from the menu, in 

what location in the screen a GUI widget to be acted on next is 
displayed, In accordance with the operating sequence previously 
registered for th selected use. by detection unit, and of 
displaying the detected GUI widget in a highlighted fashion on 
10 the screen or picture in accordance with the detected display 
location for the GUI, 
[0049] 

(e) detecting an action on the GUI widget, and 
[0050] 

15 (f) instruct i ng the detect ion un i t, i n acco rdance wl th the 

previously registered operating sequence, to detect in which 
position on the screen a GUI widget to be acted on next and 
displaying the GUI widget in a highlighted fashion on the screen 
or picture, in accordance with the detected display location of 

20 the GUI widget. 
[0051] 

A GUI control method in still another embodiment of the 
present invention preferably is comprised of the following 
respective steps: 
25 [0052] 
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(a) a step of previously registering in a storage unit the 
apDlicable use of a software adapted for running on a computer, 
the computer having a GUI, 



(b) a step of displaying the registered use In a menu on 
a screen of the display device and booting, on selection of the 
use from the menu, the software as required for the selected use, 



(c) a step of previously registering in a storage unit a 
ID screenshot for utIJ izing the booted software in the selected use, 

as a cover screen, 
[0055] 

(d) a step of hiding an inherent screen of the software 
booted from vtew and visibly displaying the registered cover 

15 screen, 

[0056] 

(e) a step of detecting an action on a GUI widget disolayed 
on said cover screen to display the next cover screen, 

[0057] 

20 (f) a step of previously registering in the storage unit 

wi dge t-re I at I on information as to which GUI widget on the 
inherent screen of the software Is to be acted on acting on any 
of the GUI widgets on the cover screen, 
[0058] 

-5 (g) a step of detecting, in accordance with the registered 



[0053] 



[0054] 
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widget-relation information, In which location on the Inherent 
screen of the software the GUI widget to be acted on next Is being 
d I sp I ayed. 
[0059] 

5 (h) a step of issuing an operating event to the detected 

GUI widget, 
[0060] 

(I) a step of previously registering widget-relation 
information as to in which GUI widget on the cover screen the 
10 data displayed on a GUI widget on the inherent screen of the 
software is to be copied and 
[0061] 

(j) copying the data displayed on the GUI widget on the 
inherent screen of the software in the GUI widget on the cover 
15 screen in accordance with the registered w 1 dge t- re I a t i on 
1 n forma t i on. 
[0062] 

A GUI control method in- still another embodiment of the 
present invention preferably is comprised of the following 
20 respect i ve steps : 
[0063] 

(a) a step of previously registering in a storage unit the 
applicable use of a software adapted for running on a computer, 
the computer having a GUI, 
25 [0064] 
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(b) a step of previously registering a screenshot for 
utilizing the soft ware in the use as a cover screen in the storage 
un i t, 



5 (c) a step of detecting, on booting the software, such 

boating, hiding an inherent screen of the software booted from 
view, visibly displaying the registered cover screen in its 
stead and displaying the applicable use of the booted software 
in a menu on a cover screen in a menu, 
10 [0066] 

(d) a step of displaying, on selection of use from the menu, 
the cover screen registered for the selected use, 

[0067] 

(e) a step of detecting an action on a GUI widget displayed 
15 on the cover screen to display the next cover screen, 

[0068] 

(f) a step of previously registering In the storage unit 
the widget-relation information as to which GUI widget on the 
inherent screen of the software is to be actuated on actuation 

20 of which GUI widget on the cover screen, 
[0069] 

(g) a step of detecting in which location on the inherent 
screen of the software the GUI widget to be acted on next is to 
be displayed in accordance with the registered widget-relation 

25 information. 



[0065] 
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[00701 

(h) a step of issuing an operating event on the detected 
GUI widget. 
[0071] 

5 li) oreviously registering in the storage unit widget- 

relation Information as to In which GUI widget on the cover 
screen data displayed on the GUI widget on the inherent screen 
of the software is to be copied, and 
[0072] 

10 (J) a step of copying data displayed in the GUI widget on 

the inherent screen of the software In the GUI widget on the cover 
screen In accordance with the registered w i dge t- r e I a t i on 
i nf ormat i on. 
[0073] 

15 [Preferred Embodiments] 

For further detailed description of the above-described 
embodiments of the present invention, certain preferred 
embodiments of the present invention are explained by referring 
to the drawings. 

20 [0074] 

Fig. 1 shows a configuration of a first embodiment of a GUI 
control apparatus according to the present invention. Referring 
to Fig. 1, the first embodiment of the present Invention includes 
use menu display unit 100, use menu registration unit 101, use 

25 se I Bc t i on detect i on un 1 1 1 02. software boot I ng un i t 103, widget 



.2001*1^ 1 20 1 88151^ MMStM NO. 6284 P, 30 



detection unit 104, ooerational sequence registration unit 105, 
operation target widget indicating unit 106, operation 
detection unit 107 and widget display unit 108. Tlie processing 
and functions of these units are realized by a program (product) 
5 executed on a computer. Meanwiiile, display unit, input unit, 
such as keyboard or pointing device, routinely provided on a 
computer executing the program, are not shown in Fig. 1. The 
computer configuration Is explained later with reference to 
Fig. 27. 
10 [0075] 

On completion of booting of the computer, the use menu 
display unit 100 demonstrates the use menu on the computer screen 
after booting. 
[0076] 

15 The "use menu" is a menu showing the applicable use($) of 

the computer (what can be done on the computer) and is registered 
at the outset by the use menu registration unit 101. 
[0077] 

F i g. 2 schematically shows typical registration on the use 
20 menu. In the embodiment shown in Frg. 2. the use menu display 
unit 100 on completion of computer booting demonstrates a menu 
20 on the screen of the booted computer. 
[0078] 

Fig. 3 shows the state of display on a computer screen. In 
25 the embod i ment of F i g. 3, a screenshot (p 1 cture screen) frame 30 
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shows the entire sere en shot, with the menu 20 being demonstrated 
centrally of the screenshot. 
[0079J 

If a user clicks and selects e.g., a "mail" as a generic 
5 category of use on the screenshot of Fig. 3, the use selection 
detection unit 102 detects this selecting operation. Since It 
is noticed from Fig. 2 that the menu displayed next is a menu 21. 
the use menu display unit 100 demonstrates the menu 21 on the 
screenshot. F I g. 4 shows this state- 
10 [0080] 

If the user clicks and selects the "read a mail" in the 
screenshot of Fig. 4, the use selection detection unit 102 
detects this selecting operation. The software boo ting unit 103 
references the Information registered in the software booting 
15 information 1, with the software booting unit 103 referencing 
the Information registered In the software booting information 
1 of Fig. 2 to boot the software. 

[0081] 

Referring to Fig. 2, parameters for booting the software 
20 necessary for "reading the mail" are registered in the software 
booting information 1. The software booting unit 103 boots the 
software in accordance with these parameters. Fig. 5a shows a 
typical screenshot immediately following the software booting. 

[0082] 

25 fn the operational seauence registration unit 105, there 
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is registered at the outset an operating sequence for use of each 
of the it ems (I.e., operational subclass steps under the generic 
category of use "Ma i I ") of the menu 21 of F i g, 2, such as "reading 
a mall" or "sending a mail" of the menu 21 of Fig. 2, or "viewing 
5 a home page" or "searching a home page " of the menu 22. By way 
of an example, the operating sequence for the item "reading a 
mail" of the menu 21 of Fig. 2 is registered as shown for example 
in F I g. 6. 
[0083] 

10 An embodiment shown in Fig. 6 shows that the operating 

sequence for "reading a mall" is as follows: 
[0084] 

(1) First, a widget having a widget label of 
"communication" and the class name of "iWlenu bar" lying on a 

15 window having a title of the "E-IMAIL" and a class name of 
"Emai IMa i nWin" is cl I cl<ed. 

(2) Next, a widget having a label "receiving a mail" and 
a class name "Menu" lying on a window having a title of tiie 
"E-MAIL" and a class name of "Ema i I Ma i n W I n " is clicked. 

20 (3) Finally, a widget having a label "OK" and a class name 

"Button" lying on a window having a title "receiving a mail" and 
a class name of "Ema i IMa inWi n" Is clicked: 
[0085] 

In accordance with the operational sequence registered by 
25 the operational sequence registration unit 105, the widget 
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detection unit 104 detects in what Dosition on the screen the 
widget to be operated next is demonstrated. 
[0086] 

It is assumed that, as an example, the user has selected 
5 "reading a maii" on the screenshot shown in Fig. 4 and that the 
operating sequence registered for this menu Item is that shown 
in F i g. 6. 
[0087] 

In this case, since the widget to be acted on first is a 
10 widget having a label of "communication" and the class name of 
"Menubar" lying on a window having a title of the "E-MAIL" and 
a class name of "Ema i I Ma i nWi n", it is detected in what position 
on the screen a widget that meets this condition is displayed. 
[0088] 

15 If, in the embodiment shown in Fig. 5a, the widget is the 

"communication" menu in Fig. 5a, the widget detection unit 104 
detects a coordinate value (x1. y1) at an upper left (end) point 
of the "communication" and a coordinate value (x2, y2] at a lower 
right (end) point of the "commun ication" menu as shown in Fig. 5 b. 

20 [0039] 

The operation target widget indicating unit 106 displays 
thewldget detected by thewidgct detection unit 104 in a readily 
noticeable manner so that the user can recognize it instantly. 
This state is shown in Figs. 7 and 8. 

25 [0090] 



•2001^ 1fll2B 18i|52^ MMtM NO. 6284 P. 34 

In the embodiments shown in Figs. 7 and 8, the widget being 
acted on is highlighted by encircling it with a frame and by 
ind i cat ing i t wi th an arrow, respectively. S ince the wi dget to 
be acted on next Is highlighted, the user may realize readily 
5 wh i ch w i dget i s to be acted on next. However, any othe r su i tab I e 
technique for highlighting the widget on the screenshot, such 
as changing an emphasizing the display color or inverting the 
displayed letters in luminosity may be used. 
[0091] 

10 If the user acts on a widget, highlighted by the operation 

target widget indicating unit 106, the operation detection unit 
T07 detects the operation. 
[0092] 

If the operation detection unit 107 detects the operation. 
15 the widget detection unit 104 detects the display position of 
the widget to be acted on next, with the operation target widget 
indicating unit 106 then highlighting the objective widget. 

[0093] 

The above-described operating sequence is repeated until 
20 the entire operating seauence registered In the operational 
sequence registration unit 105 is finished. 
[0094] 

The operation of the widget display unit 108 is as follows: 
If the widget acted on is a menu or a button, the operation 
25 thereon will be finished just on clicking. However, if the 
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widget acted on is a text field, it is unknown at tl^e outset how 
many letters are being input by the user. So, if the widget to 
be acted on is the text field, such a widget which clarifies 
(identifies) completion of inputting is demonstrated on the 
5 screenshot. 



Fig. 9 shows a typical widget demonstrated by the widget 
display unit 108. In the embodiment shown in Fig. 9, a letter 
queue is input to a text field [To:] encircled by a frame. If 
10 then a widget 90 is clicked, the operation detection unit 107 
detects the clicking, followed by instructing the widget 
detection unit 104 to detect the next widget. 



15 field, not "operation event = [click]" but "operation event = 
[letter input]" is registered. If the widget registered 
"operation event = [letter input]" Is a widget acted on, the 
widget display unit 108 demonstrates a widget like the widget 
90 of Fig. 9 on the screenshot. The display position of the 

20 widget 90 is determined on the basis of the display coordinate 
values of the widget detected by the widget detection unit 104. 



Meanwhile, the screenshot configuration shown in Figs. 2 to 
9are intended for illustratingthe invention. It is tobenoted 
25 that the present invention is not limited to the above-described 



[0095] 



[0096] 



Meanwhi le, in case where the widget to be acted on Is a text 



[0097] 
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screenshot configuration. 
[0098] 

[Embodiment 2] 

The second embodiment of the present invention is now 
5 explained* In the above-described first embodiment, the 

software is booted by the software booting unit 103 based on the 
software booting information registered at the outset in the use 
selection detection unit 102. 
[0099] 

10 In the second embodiment of the present invention, the user 

pushes a software booting key on a keyboard to boot the software. 
[0100] 

Fig. 10 shows the configuration of the second embodiment of 
the present invention. Referring to Fig. 10, if the software 
15 booting key on the keyboard is pushed to boot the software, a 
software booting detection unit 1000 detects the booting of the 
software to instruct the use menu display unit TOO to demonstrate 
the use menu for the software. 

[0101] 

20 It is assumed, as an example, that a [MAIL] key on the 

keyboard ts pushed in a state shown in Fig. 3. In this case, the 
software booting detection unit 1000 detects the booting of the 
E-MAIL software, based on the pushing of the [MAIL] key, so that 
the use menu display unit 100 demonstrates the use menu for the 

25 detected software on the screenshot. The result Is that the 
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screenshot (screen display) is as shown for example in Fig. 11, 



In the embodiment shown in Fig. 11, the window of the 
software booted on pushing the [MAIL] Iceyon the keyboard, whilst 
5 the use menu demonstrated by the use menu display unit 100 is 
B menu 21 of F i g. 2. 



As may be seen from the above-described first embodiment, 
it is possible to clarify the use of the software and the 
10 operational sequence for the use without changing the program 
of the software having the GUI. Thus it is possible for a 
beginner with only poor experience In the use of the computer 
to exploit the software. 



explained is similar to the above-described first embodiment. 

if. for example, [read i ng a ma i I ] i s se I ected on the screenshot 
of Fig. 11, the use selection detection unit 102 detects the 
selection sequence, with the widget detection unit 104 then 

20 detecting, in accordance with the operational sequence 

registered by the operational sequence registration unit 105. 
in which position on the screen the widget to be acted on next 
is displayed. The operation target widget indicating unit 106 
then highlights the widget detected by the widget detection unit 

25 1 04 on the screenshot. The result Is that the screenshot is as 



[0102] 



[01 03] 



[0104] 



15 



The second embodiment of the present 



invention now 
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shown in F i g. 7 or 8. 
[0105] 

As may be seen from the above-described second embodiment, 
it Is possible to clarify the use of the software and the 
5 operational sequence for the use without changing the orograra 
of the software having the GUI. Thus it is possible for a 
beginner with only poor experience in the use of the computer 
to expioi t the software. 

[0t06] 

10 [Embodiment 3] 

A third embodiment of the present Invention is now 
explained. F i g. 1 2 shows the configuration of the third 
embodiment of the present Invention. Referring to Fig. 12, a 
cover screen display unit 1201 demonstrates a cover screen on 
15 the as-booted computer screen. 
[0107] 

The [cover SCREEN] Is a display window screenshot 
demonstrated on the uppermost surface of a multi-window to the 
same size as the background picture size (e. g. t screen size). 
20 By displaying the window of the cover screen (screenshot) to the 
same size as the background picture, the basic picture 
(screenshot) of the as-booted computer Is hidden by the window 
of the cover screen from the sight of the user. 

[01081 

25 The cover screen demonstrated by the cover screen display 
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unit 1201 is registered at the outset by cover screen 
reg j s t ra t i on unit 1 200. 
[0109] 

If the cover screen display unit 1201 demonstrates the 
5 window of the cover screen, use menu display unit 1202 

demonstrates the use menu on the window of the cover screen. 
Similarly to the above-described first embodiment! the use menu 
represents the use of the computer (what can be done by using 
the comDuterl, as in the above-described first embodiment, and 
10 is registered at the outset by the use menu registration unit 
1 202. 

[0110] 

Fig. 13 schematically shows typical registration on the use 
menu. in the embodiment shown in Fig. 13, if the cover screen 
15 display unit 1201 demonstrates the window of the cover screen, 
a menu 1 300 is displayed on the window, as shown as an example 
In Fig. 14, 

[01 11] 

If, in the screenshot s hown inFig»14, the user c[icl<s and 
20 selects [MAIL], the use selection detection unit 1204 detects 
the selecting operation. Then, software booting unit 1205 
references the information registered in the software booting 
information 1 of Fig. 13 to boot the software. in the software 
booting information 1 of Fig. 13, there are registered booting 
25 parameters for the E-MAIL software, such that the software 
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booting unit 1 205 boots the software using tliese parameters. 
[0113] 

On booting the software, its window is displayed on the 
screen. However, since the window of the cover screen with the 
5 same size as the screenshot is displayed on the uppermost layer 
of the multi-window, the screen of the as-booted computer is 
hidden by the window of the cover screen from the sight of the 
user. 

C0114] 

10 If. in the screenshot of Fig. 14, the user c I I cks and se I ect 

[MAIL], as an example, since the menu to be displayed next Is 
a menu 1301 (Fig. 13), user menu display unit 1 203 demonstrates 
the menu 1301 on the screen in parallel with the software booting 
by software booting unit 1 205. Fig. 15 shows a typical such 

15 state and displays the demonstrating screenshot for the use 
menu. 

[0115] 

In widget-relation registration unit 1210, It is pre- 
registered which widget of the software booted by the software 
20 booting unit 1205 Is to be acted on when a given widget on the 
cover screen is acted on. 
[0116] 

Fig. 16 shows a typical case of registration (Instance of 
the relation with registered widgets). It Is registered in the 
25 embodiment shown In Fig. 16, a widget [reading a mai I] is acted 
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on in the cover screen window, it suffices to execute the 
fol lowing three operations fn succession for the software booted 
by the software booting unit 1205: 
[0117] 

5 (1) First, awidgetwithalabel "communication" and a class 

name "Menubar", lying on a window with a class 
naine"Ei»ia i IMa i nWi n" and a title "E-MAIL" Is clicked; 

(2) Second, a widget with a label "Receiving a Mail" and 
a class name "Menu", lying on a window with a class 

10 name"Ejnai IMainWin" and a title "E-MAIL" is clicked; and 

(3) Third, a widget with a label "OK" and a class name 
"Button", lying on a window with a class name "Emai IMainWin" and 
a title "Receiving a Mail" is clicked. 

[0118] 

15 If, In the screenshot shown in Fig. 15. the user clicks and 

selects [reading a mall], the use selection detection unit 1204 
detects the selecting operation, and widget detection unit 1207 
then detects the display position of a widget with an operating 
number = 1 registered in the widget-relation registration unit 

20 1210. 

[0119] 

If thewindowof the software booted by the software booting 
unit 1205 is the window of Fig. 17, the widget with the operating 
number = 1 in Fig. 16 is the [communication] menu on the window 
25 of Fig.17, so that the widget detection unit 1207 detects the 
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display position with tlie operating number = 1 of the 
widget-relation registration table (Fig, 16) registered in the 
widget-relation registration unit 1210. 
[0120] 

5 Since the window of Fig. 17 is displayed on a lower level 

surface of the cover screen window, the window of Fig. 17 is not 
visible to the user. 
[0121] 

When the widget detection unit 1207 detects the display 
10 position of the [communication] menu of Fig. 17, operation event 
issuing unit 1208 issues an operating event of selecting the 
[communication] menu. 

[0122] 

On the screenshot, the cover screen window is demonstrated 
15 on the uppermost level surface of the cover screen window, with 

the window of Fig. 17 being on its lower level surface, the event 

issued by the operation event issuing unit 1208 is notified not 

to the cover screen window but to the hidden window of Fig. 17 

lying on its lower level surface. 
20 [0123] 

The widget detection unit 1207 then detects the display 

position of the widget with the operat i ng number = 2 of Fig, 16. 

with the widget detection unit 1207 then Issuing an operating 

event for the detected widget, as before. 
25 [0124] 
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The widget detection unit 1207 then detects the display 
position of the widget with the operating number = 3 of Fig. 16. 
with the widget detection unit 1207 then issuing an operating 
event for the detected widget. 
5 [0125] 

As a resuit, the software window booted by the software 
booting unit 1 205 is as shown in Fig. 18. 
[0126] 

At a time point the use selection detection unit 1204 has 
10 detected the user operation of selecting [reading a mail] on the 
screenshot shown in Fig. 15, the cover screen display unit 1201 
demonstrates a screenshot pre-regi stered by the cover screen 
registration unit 1 200. This state is shown in Fig. 19. 

[0127] 

15 After the operation event issuing unit 1208 has issued an 

operating event for the widget with the operating number = 3 of 
Fig. 16, displayed data copying unit 1209 copies data 
demonstrated on the widget of the software window booted by the 
software booting uni t 1205 on a widget on the window of the cover 

20 screen demonstrated on the cover screen display unit 1201. 
[0128] 

In the widget-relation registration unit 1210, it is 
pre-regi stered which data displayed on which widget is to be 
copied on which data. Figs. 20 and 21 show these registration 
25 instances. 
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[0129] 

In the case of Fig. 20, it is indicated that data displayed 
on a widget (assumed to be a widget 1800 of Fig. 18) wi th the label 
[From:] and the class name of [Edit] lying on the window with 
5 the ti tie [MAIL DISPLAY] and with the class name [EmailViewWin] 
istobecooiedonawidget (assumedtobeawidgetigOOofPig. 19) 
with the ID (Identification information) of [FromFleld] lying 
on the cover screen window. 
[0130] 

10 Lil<ewise. in the case of Fig. 21, it is indicated that data 

displayed on a widget (assumed to be a widget 1801 of Fig. 18) 
with the label [MESSAGE:] and the class name of [Edit] lying on 
the wi ndow with the title [MAI L D I SPLAY] and with the class name 
[EmailViewWin] i s to be cop i ed on a wi dget (as sumed to be a w i dget 

15 1901 of Fig. 19) with the ID of [BodyField] lying on the cover 
screen window. 
[0131] 

In this case, the displayed data copying unit 1 209 copies 
the data displayed on the wid gets 1800 and 1801 shown in Figs. 18, 
20 19, respectively, on the widgets 1 900 and 1901 shown in Fig. 19. 
[0132] 

As a result, the cover sc reen i s as shown i n F i g. 22, inwhich 
it is shown that three buttons, namely [READ PREVIOUS MAIL], 
[READ NEXT MAIL] and [RETURN TO MENU] are provided on the cover 
25 screen window. 
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[0133] 

It is assumed that correspondence of the widgets to the 
buttons [READ NEXT MAIL] and [RETURN TO MENU] is registered by 
the widget-relation registration unit 1210 as shown in Figs. 23 
5 and 24. 

[0134] 

in the case of Fig. 23, it is registered that. If the button 
[READ NEXT 1*AIL] is selected in the screenshot of Fig. 22, it 
suffices if the following two operations: 
10 (1) operation of clickingawi dget with a label [MAIL] and 

a class name [Menubar] lying on the window with the class name 
of [Enai ImainWin] and with the title [E-MAIL], and 

(2) operation of clicking a widget with a label [DISPLAY 
NEXT MAIL] and a class name [Menu] lying on the window with the 
15 class name of [Ema i I ma i n W i n] and with the title [E-MAIL] 

are sequentially executed on the software booted by the 
software booting unit 1205. 
[0136] 

Similarly, in the case of Fig. 24, it is registered that. 
20 if the button [return to menu] is selected in the screenshot of 
Fig. 22, it suffices if the following operation: 
[0137] 

(1) the operation of clicking a widget with a label [CLOSE] 
and a class name [Button] lying on the win dow with the class name 
25 of [Eraal IVi ewWIn] and with the title [DISPLAY MAIL] 
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is executed on the software booted by the software booting 
unit 1 205. 
[0138] 

If. in the screenshot of Fig. 22. the user cl i cks and se I ects 
5 the button [READ NEXT MAIL], operation detection unit 1206 
detects the operation, with the widget detection unit 1207 
detecting the display position of a widget with the operating 
number = 1 of the widget-relation registration table of Fig. 23 
registered by the widget-relation registration unit 1210. 
10 [0139] 

It is assumed that the window of the software, booted by 
the software booting unit 1 205, is as shown in Fig. 18, with the 
widget with the operating number = 1 being the [MAIL] menu on 
the [E-MAIL] window of Fig. 18. In this case, the widget 

15 detection unit 1 207 detects the (x. y) coordinate value on the 
left upper (end) point and the (x, y) coordinate value on the 
right lower (end) point of the [MAIL] menu. However, since the 
[E-MAIL] window and the [MAIL DISPLAY] window of Fig. 18 are 
displayed on a lower level surface of the cover screen, the two 

20 windows of F i g. 1 8 are not visible to the user. 
[0140] 

If the widget detection unit 1207 detects the display 
position of the [MAIL] menu of Fig. 18, the operation event 
issuing unit 1208 issues an operating event for the detected 
25 widget, as before. 
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[0141] 

The wideet detection unit 1207 then detects the display 
position of the widget with the operating number = 2 of Fig. 23. 
with the widget detection unit 1207 then issuing an operating 
5 event for the detected widget. 
[0142] 

As a result, the software window booted by the software 
booting unit 1 205 Is as shown in Fig.25, 
[0143] 

0 The displayed data copying unit 1209 copies the data 

demonstrated on the widgets 1 800, 1801 of Fig. 25 on the widgets 
1 900. 1 901 of F ig. 22. as I n the above-desc r I bed embod i men t. As 
a result, the cover screen windows as shown in Fig. 26, 



If then the user clicks the button termed [RETURN TO MENU] 
in the screenshot of Fig. 26, the operation detection unit 1206 
detects thisoperation tonotify to thecoverscreen dlsplayunit 
12D1 that the menu screenshot of Fig. 14 be displayed. 



The widget detection unit 1207 detects the display position 
of the widget with the operating number = 1 In the wldget- 
reiation registration data of Fig. 24 registered by the 
widget-relation registration unit 1210. 



If the window of the software booted by the software booting 



[0144] 



[0145] 



[0146] 
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unit1205isasshowninFig. 25, andthewidgetwiththeoperating 
number = 1 of Fig. 24 is a button [CLOSE] on the window [DISPLAY 
MAIL] of Fig. 25. the wi dget detect ion u.n i t 1 207 detects a (x, y> 
coordinate value at tlie left upper (end) point and a (x, y) 
5 coordinate value at the right lower (end) point of the button 
[CLOSE]. 

[0147] 

If the widget detection unit 1207 detects a display 
position of the button [CLOSE] of Fig. 25, the operation event 
10 issuing unit 1208 issues an operational event of selecting the 
detected [CLOSE] button, as before. 
[0148] 

The result is that the window of the software booted by the 
software booting unit 1 205 returns to the state shown in Fig. 17. 
15 [0149] 

In the third embodiment of the present invention, as may 
be seen from the above-described first embodiment, it is 
possible to clarify the applicable use of the software having 
theGUI and tociarify theoperatingsequence for this applicable 
20 use, without changing the program of the software. So, even a 
beginner with only little experience in using the computer may 
use the software. 

[0150] 

A fourth embodiment of the present invention is hereinafter 
25 explained. In the above-described third embodiment, the 
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software booting unit 1205 boots the software, based on the 
software booting Information registered in the use menu display 
unit 1202. In the present fourth embodiment, a user pushes a 
software booting key on the keyboard to boot the software. 
5 Fig. 27 shows the configuration of the fourth embodiment of the 
present invention. 



Referring to Fig. 27, if a software booting key on a keyboard 
is pressed to boot the software, the software booting detection 
10 unit 1 000 detects the booting of the software to notify the user 
menu display unit 1203 that the use menu for the software be 
displayed. 



15 and a [MAIL] key on the keyboard has been pushed. in this case, 
the software booting detection unit 1000 detects that the 
software of the E-MAIL program has been booted by the pressing 
of the [MAIL] key, with the user menu display unit 1203 then 
causing the use menu for the detected software to be displayed 

20 on a widow of the cover screen. 



The result is that the displayed screenshot is as shown in 
Fig. 15. The following operation is the same as that In the 
above-described third embodiment. That is, in the fourth 
25 embodiment, the window of the software booted on pressing the 



[0151] 



[0152] 



Assume that the screenshot is in a state shown in Fig. 14, 



[0153] 
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software boot key on the keyboard is displayed as a lower surface 
on the cover screen and hence is not visible froni the user. 
[0154] 

In the fourth embodiment of the present invention, it is 
again possible to clarify the applicable use of the software 
having the GUI and to clarify the operating sequence for this 
applicable use, without changing the program of the software. 

So, even a beginner with only little experience in using the 
computer may use the software. 
[0155] 



/ [Fifth Erabodim^nt] 

A fifth embodlnent of the present invention is now 
explained. Fig. 28 $l|ows the configuration of the fifth 
embodiment of the prjesent invention. The present fifth 
15 embodiment of the prlesent invention realizes the GUI control 
device of the above-described first to fourth embodiments by the 
executable program (GUI control program) running on a computer, 
as exemplified by PC or WS. Fig. 28 shows an illustrative 
structure of a computelr. The executable program (contemplated 
20 as a program product)! is recorded on a recording medium 2801 
exemplified by a hardldisc, a floppy disc, a CD-ROM, an MT 
(magnetic tape] or a DUD (digital versatile disc), and is read 
out to the computer 2800lfor execution to cause the computer 2800 
to operate a GUI control Id evice explained in the above-described 
25 first to fourth embod i mien t $. Output unit for outputting the 
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Operational result is a display Also* data registered In 

the use selection unit or in t h/e opera t i ona I sequence 
registration unit are record^ on a recording device provided 
on the computer, such as a^^RAM (random access memory) or on a 
5 recording fnedlum such as/a hard disc* or on the recording mediurn 
2801, if the recording medium 2801 is recordable, so as to be 
read out to the coni/uter 2801 for processing by the executable 
program, Note. Ii/owever, the program may be supplied through 
Internet or othe/r source in a running or dynamic state carried 
10 on a carrier w/ave. 
[0156] 

The meritorious effects of the present invention 
are summarized as follows. 

As described above, the following meritorious effects are 
15 achieved with the use of the GUI control method or apparatus 
according to the present invention: 
[0157] 

The first meritorious effect of the present Invention is 
that the software can be utilized even by a beginner with only 

20 poor experience in the use of the computer. The reason is that, 
according to the present invention, it is possible to clarify 
the applicable use of the software having the GUI and to clarify 
the operating seauence for this appi icable use, without changing 
the program of the software. 

25 [0158] 
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The second meritorious effect of the present invention is 
that the software can be utilized even by a beginner with only 
poor experience in the use of the computer. The reason is that, 
according to the present invention, it is possible to clarify 
5 the applicable use of the software having the GUI and to display 
a more simplified screenshot in which only GUI widgets for the 
necessary functions are displayed. 

It should be noted that other objects, features and aspects 
of the present invention will become apparent in the entire 
10 disclosure and that modifications may be done without departing 
the gist and scope of the present invention as disclosed herein 
and claimed as appended herewith. 

Also It should be noted that any combination of the 
disclosed and/ or claimed elements, matters and/or items may fall 
15 under the modifications aforementioned. 



